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1.  INTRODUCTION 


In  an  environment  of  shrinking  resources,  Leadership  is  more  important  then  ever.  As  the 
Army  Chief  of  Staff,  General  Oclierno  said,  “The  Army’s  No.  1  priority  continues  to  be  leader 
development  within  both  the  officer  and  noncommissioned  officer  ranks.”  [6]  With  leadership 
remaining  such  a  critical  priority,  it  is  important  that  the  army  have  analytical  tools  to  aid  in 
leadership  assessment.  The  Leadership  Wargame  was  developed  by  the  TRADOC  Analysis 
Center’s  (TRAC)  Military  Research  Office  to  provide  Army  leaders  an  environment  where 
leadership  can  be  in  exhibited,  measured,  and  assessed.  The  Leadership  Assessment  Tool 
(LAT)  was  developed  in  conjunction  with  the  Leadership  Development  Wargame  (LDW)  to 
provide  unit  leaders  a  framework  for  leadership  assessment. 


1.1.  Problem  Statement 

The  focus  of  this  research  is  to  to  develop  an  assessment  tool  that  evaluates  player  leadership 
during  the  LDW. 

1.1.1.  Issues  for  Analysis 

Issue  1:  Does  the  tool  assess  leadership? 

EEA  1.1:  Does  the  tool  observe  and  record  appropriate  data? 

EEA  1.2:  Does  the  tool  map  appropriate  competencies  and  attributes  from  the  data? 

EEA  1.3:  Does  the  tool  return  a  usable  leadership  assessment  to  the  individual? 

EEA  1.4:  Does  the  tool  provide  a  usable  consolidated  leadership  assessment  to  unit 
leaders? 

1.2.  Constraints  limitations,  and  Assumptions 

Constraints  limit  the  study  team’s  options  to  conduct  the  study.  Limitations  are  a  study 
team’s  inabilities  to  investigate  issues  within  the  sponsor’s  bounds.  Assumptions  are  study- 
specific  statements  that  are  taken  as  true  in  the  absence  of  facts. 


•  Constraints 

—  Complete  assessment  tool  NLT  30APR14. 
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—  Assessment  must  be  focused  upon  leadership  development  as  outlined  in  ADP 
6-22  (Leads,  Develops,  Achieves). 

•  Limitations 

—  Development  of  the  leadership  metrics  will  be  accomplished  using  subject  matter 
expertise. 

—  Leadership  assessment  will  not  provide  individual  leadership  assessments  to  senior 
unit  leaders. 

•  Assumptions 

—  The  development  of  the  leadership  wargame  will  occur  as  scheduled. 

—  Leadership  attributes  and  competencies  provide  an  appropriate  framework  for 
leadership  assessment. 

—  The  assessment  is  intended  to  provide  individual  feedback  to  participants  and 
consolidated,  anonymous  feedback  to  senior  unit  leaders. 


1.3.  Project  Team 

•  Sponsor:  TRAC  Military  research  Office  (MRO) 

•  Project  Lead:  MAJ  Edward  Masotti  (TRAC-MTRY) 

•  NPS  Faculty: 

—  Dr.  Jeff  Appleget  (Professor,  OR) 


1.4.  Project  Methodology 

This  project  is  focused  on  the  development  of  the  leadership  assessment  tool.  There  were 
four  main  phases  to  the  project.  All  four  phases  were  conducted  in  conjunction  with  the 
development  of  the  LDW.  The  first  phase  was  focused  on  problem  definition  and  included 
literature  review  as  well  as  identification  of  appropriate  assessment  techniques. 

The  second  phase  was  focused  on  assessment  development.  This  involved  creating  an  assess¬ 
ment  tool  prototype  and  testing  that  tool  during  wargame  playtests. 

The  third  phase  was  focused  on  refining  of  the  assessment  tool.  This  was  an  iterative  process 
based  on  successive  playtests  and  refinement  of  both  the  LDW  and  the  LAT. 

Finally,  we  provided  documentation  of  an  assessment  tool  guidebook  (see  appendix  A)  as 
well  as  documentation  of  the  leadership  assessment  process  in  the  form  of  this  technical 
memorandum  and  a  project  out-brief.  This  methodology  is  shown  in  figure  1-1. 
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Figure  1-1:  Leadership  development  methodology. 


1.5.  Project  Timeline 


We  executed  this  project  according  to  the  following  timeline. 


15  NOV  13 
15  JAN  14 
31  JAN  14 
28  FEB  14 
30  APR  14 
30  JUN  14 


Review  problem  and  approach. 
Initial  assessment  tool  prototype. 
Revised  assessment  tool. 
Playtesting. 

Assessment  tool  complete. 

Final  IPR. 


1.6.  Report  Organization 

Chapter  1  of  this  technical  report  gives  the  background  information,  the  problem  definition, 
and  the  research  methodology.  Chapter  2  provides  a  description  of  the  LDW  and  LAT. 
Chapter  3  provides  analytical  methodology  we  used  to  address  the  issue  for  analysis.  Chapter 
4  provides  our  discussion  and  recommendations. 
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2.  LEADERSHIP  WARGAME  AND  ASSESSMENT 


In  2012,  the  army  developed  a  leadership  model  based  on  attributes  (Character,  Presence, 
Intellect)  and  competencies  (Leads,  Develops,  Achieves)  [3] .  The  army  then  used  this  new 
model  to  revise  both  the  Officer  and  Non-Commissioned  Officer  evaluation  systems  and 
publish  the  Army  Performance  Evaluation  guide  [5]  to  complement  the  release  of  the  new 
evaluation  model  in  March  of  2014.  The  new  army  leadership  model  was  chosen  as  the  frame¬ 
work  for  a  wargame  and  assessment  to  best  represent  today’s  complex  operating  environment 
and  complement  the  army’s  focus  on  cultural  leadership  change. 


2.1.  Leadership  Development  Wargame 

The  LDW  is  a  multidimensional  strategy  game  set  in  the  Phillipines  with  seven  players. 
These  players  include  the  Host  Nation  (Philippines  government),  U.S.  Joint  Forces,  U.S. 
Department  of  State,  Nongovernmental  Organizations,  New  Peoples  Army,  Moro  National 
Liberation  Front,  and  Abu  Sayyaf.  The  game  is  played  in  a  sequence  of  turns  and  was 
designed  to  stress  leadership  competencies.  Each  player  has  his  or  her  own  objectives  but 
can  not  achieve  success  without  assistance  from  other  players  in  the  game.  All  players  must 
grasp  and  juggle  multiple,  simultaneous  issues  and  consider  not  only  first  order  effects  but 
also  second  and  third  order  effects  of  subsequent  turns  in  the  game.  The  game  board  is 
shown  in  figure  2-1. 


Figure  2-1:  Leadership  wargame  game  board. 

The  LDW  Provide  players  with  an  opportunity  to  gain  a  basic  understanding  into  the  com¬ 
plexities  of  shaping  and  deterrence  phases  of  joint  operations  as  well  as  counterinsurgencies. 
During  the  shaping  phase,  activities  are  performed  to  dissuade  or  deter  potential  adversaries, 
ensure  success  by  shaping  perceptions  and  influencing  the  behavior  and  developing  partner 
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nation  and  friendly  military  capabilities  for  self-defense  and  multinational  operations.  Dur¬ 
ing  the  deterrence  phase,  activities  are  performed  to  deter  undesirable  adversary  action  by 
demonstrating  the  capabilities  and  resolve  of  the  joint  force.  [1] 

To  effectively  lead  in  a  counterinsurgency  operation  individuals  should  understand  both  coun¬ 
terinsurgency  and  insurgency  perspectives.  Joint  Publication  3-24  defines  counter  insurgency 
and  insurgency  in  the  following  ways.  Counterinsurgency  is  a  comprehensive  civilian  and 
military  effort  designed  to  simultaneously  defeat  and  contain  insurgency  and  address  its 
root  causes.  Insurgency  is  the  organized  use  of  subversion  and  violence  to  seize,  nullify,  or 
challenge  political  control  of  a  region.  [2] 

The  game  is  designed  to  reinforce  several  key  concepts.  First,  player  objectives  demon¬ 
strate  potential  real-world  motivations  and  goals.  These  overlapping  objectives  demonstrate 
the  difficulties  of  working  with  competing  factions  and  developing  consensus  and  buy-in  to 
achieve  the  desired  results.  Second,  player  cards  provide  a  read-ahead  to  learn  about  the 
strengths,  weaknesses,  desires  and  motivations  of  current  players  in  the  Philippines  AOR. 
Third,  threat  actors  have  different  objectives  and  capabilities.  Finally,  Host  Nation  and 
NGOs  must  cooperate  with  friendly  and  threat  players  to  achieve  success  in  the  game. 


2.2.  Leadership  Assessment  Tool 

The  LAT  is  designed  to  analyze  and  assess  leadership  traits.  The  primary  references  for 
leadership  are  found  in  the  Army  Leadership  ADRP  6-22  [4]  and  Army  Performance  Eval¬ 
uation  Guide.  [5]  The  leadership  wargame  is  designed  to  provide  a  setting  which  requires 
interactions  between  players  during  the  course  of  the  game.  These  interactions  provide  an 
opportunity  to  demonstrate  leadership  in  a  competitive  environment.  This  allows  for  an 
evaluation  of  each  player  based  on  the  core  attributes  of  Character ,  Presence  and  Intellect 
and  the  core  competencies  of  Leads ,  Develops ,  and  Achieves  found  in  the  Army  Leadership 
Requirements  Model [4]  shown  in  figure  2-2. 


ATTRIBUTES 

CHARACTER 

PRESENCE 

INTELLECT 

*  Army  Values 

*  Military  and  professional  bearing 

'  Mental  agility 

*  Empathy 

*  Fitness 

*  Sound  judgment 

*  Warrior  Ethos/Service 

•  Confidence 

*  Innovation 

Ethos 

*  Resilience 

*  Interpersonal  tact 

*  Discipline 

•  Expertise _ j 

LEADS 

DEVELOPS 

ACHIEVES 

*  Leads  others 

*  Creates  a  positive  environment/ 

*  Gets  results 

*  Builds  trust 

Fosters  esprit  de  corps 

*  Extends  influence  beyond 

*  Prepares  self 

the  chain  of  command 

*  Develops  others 

*  Leads  by  example 

’  Stewards  Ihe  profession 

*  Communicates 

COMPETENCIES 

Figure  2-2:  Army  leadership  model  as  described  in  ADRP  6-22. 
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3.  METHODOLOGY 


As  described  earlier,  this  project  was  focused  on  the  development  of  the  LAT  in  conjunction 
with  the  development  of  the  LDW. 


3.1.  Game  Development 

In  order  to  appropriately  provide  leadership  feedback  to  game  participants,  it  was  critical 
that  assessment  was  incorporated  during  all  phases  of  game  development.  Using  the  leader¬ 
ship  model,  we  developed  an  initial  leadership  assessment  concept  focused  on  developing  an 
objective  framework  to  measure  attributes  and  competencies. 


3.2.  Assessment  Development 

Assessment  of  leadership  provides  several  challenges.  One  challenge  is  that  leadership  carries 
with  it  a  significant  amount  of  intangibility.  That  is,  senior  leaders  will  describe  good 
leadership  as  “I  know  it  when  I  see  it.”  This  makes  it  difficult  to  measure  in  a  predictable 
manner.  Another  challenge  is  that  leadership  is  an  enduring  function.  This  means  that 
leadership  is  best  measured  over  longer  periods  of  time.  A  third  challenge  is  that  leadership 
assessment  is  subjective.  What  one  individual  may  view  as  a  leadership  strength,  another 
may  view  as  a  weakness.  These  challenges  and  others  make  leadership  assessment  a  sensitive 
subject. 

We  developed  the  LAT  described  in  appendix  A  to  provide  an  objective  framework  for 
measuring  leadership.  It  does  not  eliminate  subjectivity  in  the  process  nor  does  it  capture  all 
aspects  of  leadership.  It  does,  however,  proscribe  a  way  of  assessing  leadership  by  identifying 
and  describing  the  multiple  aspects  of  leadership  that  can  be  observed  during  the  play  of 
the  wargame. 


3.3.  Assessment  Refinement 

Game  development  is  an  iterative  process  in  which  the  game  is  developed,  playtested,  feed¬ 
back  is  received  from  both  players  and  observers,  and  refinements  are  made  to  the  game. 
This  process  is  repeated  until  the  game  development  team  is  satisfied  that  the  game  meets 
the  design  concept  and  objectives.  The  LAT  development  mirrors  this  process. 

Initial  assessment  tool  development  focused  only  leadership  competencies.  Iterative  playtest¬ 
ing  and  feedback  identified  that,  with  the  length  of  play  (4  to  6  hours),  both  competencies 
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and  attributes  could  be  observed  by  players. 


3.4.  Documentation 

The  key  product  produced  for  this  project  is  the  Leadership  Assessment  Guide.  This  guide, 
found  in  Appendix  A,  provides  a  detailed  description  of  the  leadership  attributes  and  com¬ 
petencies.  It  also  describes  the  leadership  evaluation  process  and  the  roles  required  for  the 
LDW.  It  provides  and  describes  assessment  sheets  that  are  to  be  used  during  the  game  by 
evaluators.  Finally,  it  provides  examples  to  aid  in  the  leadership  evaluation  process. 
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4. 


DISCUSSION  AND  RECOMMENDATIONS 


4.1.  Discussion 

The  LAT  is  intended  to  provide  leaders  an  understanding  and  evaluation  of  leadership  in 
a  non-attributional  format.  While  patterned  after  the  army  leadership  model,  it  is  not 
intended  to  inform  an  individual’s  evaluation  report.  Rather,  it  is  intended  to  provide  units 
with  an  idea  of  where  leadership  strengths  and  weaknesses  exist  within  that  unit  as  a  whole. 
However,  if  taken  seriously,  an  individual  can  over  a  short  period  of  time  get  an  idea  of  their 
own  personal  strengths  and  weaknesses  and  thus  develop  strategies  to  improve  leadership. 

There  are  expectations  that,  if  followed,  will  improve  the  value  of  the  entire  process.  Ideally, 
roles  are  assigned  at  least  a  week  prior  to  the  start  of  the  game.  This  allows  players  and 
evaluators  time  to  prepare  for  their  prospective  roles.  Players  and  evaluators  should  conduct 
additional  research  to  aid  them  in  the  conduct  of  their  game  and  evaluation  strategies. 
Potentially,  this  additional  research  can  be  captured  and  shared  in  a  strategic  estimate, 
or  similar  document  and  could  be  presented  before,  during,  or  after  the  game  play.  This 
should  include  a  description  of  the  Army  leadership  model  that  evaluators  are  using  for  their 
assessment. 

Another  critical  expectation  is  that  of  anonymity.  The  initial  interview  and  feedback  AAR 
is  a  personal  two  way  conversation  between  the  evaluator  and  player.  The  evaluators  present 
their  observations  tactfully  about  the  player  but  also  capture  additional  insights  from  the 
player  about  other  player’s  leadership.  These  insights  are  then  provided  to  a  Senior  evaluator 
but  are  done  so  without  names  attached. 

The  consolidated  AAR  is  intended  to  be  an  anonymous  evaluation  of  leadership  trends  and 
is  led  by  the  senior  evaluator.  The  goal  of  the  consolidated  AAR  is  to  identify  leadership 
trends.  It  is  not  intended  to  discuss  the  game  itself  except  where  that  discussion  focuses  on 
leadership.  Winning  (getting  results)  is  part  of  leadership  and,  therefore,  should  NOT  be 
omitted  from  the  conversation.  However,  winning  is  only  one  portion  of  the  assessment. 

Ideally,  the  senior  evaluator  will  provide  a  report  to  the  unit  leader  on  trends  of  leadership 
found  from  conduct  of  the  LDW.  This  may  be  as  simple  as  the  unit  leader  attending  the 
AAR  or  may  include  a  final  writeup  from  the  senior  evaluator. 


4.2.  Recommendations 

We  recommend  that  the  LAT  be  used  as  tool  for  unit  leaders  to  gain  an  understanding  of 
leadership  within  the  concept  of  a  staff  ride.  While  the  LAT  is  intended  to  complement 


the  leadership  wargame,  it  can  be  used  to  evaluate  leadership  in  other  training  environ¬ 
ments  in  which  interactions  occur  between  individuals  or  groups.  It  can  be  modified  to  be 
more  inclusive  (adding  additional  dimensions  of  leadership)  or  restrictive  (focusing  only  on 
attributes  or  competencies  or  even  very  specific  attributes  or  competencies).  As  described 
earlier,  Leadership  can  be  extremely  difficult  to  measure  and  assess.  Ultimately,  the  LAT 
provides  a  framework  to  aid  the  leadership  assessment  process. 
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A.  LEADERSHIP  WARGAME  ANALYSIS 

GUIDEBOOK 


The  Leadership  Wargame  Analysis  Guidebook  is  intended  to  be  a  stand-alone  document 
which  describes  the  background,  components,  and  process  of  leadership  assessment  within 
the  context  of  the  conduct  of  the  LDW. 


A-l 


Leadership  Wargame  Analysis  Guidebook 


October  14,  2014 


1 


1  Wargame  Leadership 


The  leadership  wargame  is  designed  to  analyze  and  assess  leadership  traits.  The  primary  reference 
for  leadership  are  found  in  the  Army  Leadership  ADRP  6-22  [1]  and  Army  Performance  Evaluation 
Guide  [2].  The  leadership  wargame  is  designed  to  provide  a  setting  which  requires  interactions 
between  players  during  the  course  of  the  game.  These  interactions  provide  an  opportunity  to 
demonstrate  leadership  in  a  competitive  environment.  This  allows  for  an  evaluation  of  each  player 
based  on  the  core  attributes  of  Character,  Presence  and  Intellect  and  the  core  competencies  of 
Leads ,  Develops,  and  Achieves  found  in  the  Army  Leadership  Requirements  Model  shown  in  figure 
l.[l] 


ATTRIBUTES 

CHARACTER 

PRESENCE 

INTELLECT 

*  Army  Valies 

’  Military  and  professional  bearing 

*  Mental  agility 

•  Empathy 

*  Fitness 

'  Sound  judgment 

•  Warrior  Ethos/Service 

•  Confidence 

*  Innovation 

Ethos 

•  Resilience 

*  Interpersonal  tact 

*  Discipline 

•  Expertise 

LEADS 

DEVELOPS 

ACHIEVES 

*  Leads  others 

*  Creates  a  positive  environment/ 

•  Gets  results 

*  Builds  trust 

Fosters  esprit  de  corps 

*  Extends  influence  beyond 

*  Prepares  self 

the  chain  of  command 

•  Develops  others 

*  Leads  by  example 

*  Stewards  Ihe  profession 

*  Communicates 

COMPETENCIES 

Figure  1:  Leadership  model  as  described  in  ADRP  6-22. 


1.1  Leadership  Wargame 

The  game  is  a  multidimensional  strategy  game  set  in  the  Phillipines  with  seven  players.  These 
players  include  the  Host  Nation  (Philippines  government),  U.S.  Joint  Forces,  U.S.  Department  of 
State,  Nongovernmental  Organizations,  New  Peoples  Army,  Moro  National  Liberation  Front,  and 
Abu  Sayyaf.  This  game  is  described  in  detail  in  the  leadership  wargame  guide.  This  game  was 
developed  specifically  to  generate  leadership  interactions  and  and  therefore  allow  for  leadership 
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evaluation  and  assessment.  Although  the  leadership  wargame  and  this  leadership  assessment  were 
developed  to  mutually  support  each  other,  the  processes  described  in  this  guide  can  be  adapted  and 
applied  to  additional  scenarios  or  games  that  also  seek  to  assess  leadership.  The  remainder  of  this 
guide  will  describe  the  processes  and  tools  used  to  assess  leadership. 

2  Leadership  Attributes 

To  understand  how  best  to  evaluate  leadership  within  the  wargame,  it  is  critical  that  everyone 
involved  have  a  common  understanding  of  leadership  attributes.  Leader  attributes  are  inward  char¬ 
acteristics  of  the  individual  that  shape  the  motivations  for  actions  and  bearing,  and  how  thinking 
affects  decisions  and  interactions  with  others. [2].  These  attributes  include  Character,  Presence, 
and  Intellectual  Capacity. 

2.1  Character 

Character  is  comprised  of  a  person’s  moral  and  ethical  qualities,  helps  determine  what  is  right,  and 
gives  a  leader  motivation  to  do  what  is  appropriate,  regardless  of  the  circumstances  or  consequences.  [1] 
Character  includes  Army  Values,  Empathy,  Warrior  Ethos  and  Sendee  Ethos  and  can  be  found  de¬ 
scribed  in  detail  in  ADRP  6-22.  While  character  is  an  important  aspect  of  leadership,  it  is  very 
difficult  to  capture  in  a  game  setting.  Although  described  here  as  part  of  the  leadership  attributes 
for  completeness,  evaluators  will  not  address  character  during  the  evaluation  process.  We  include 
this  brief  description  here  to  ensure  that  participants  in  the  game  understand  all  aspects  of  leader¬ 
ship  and  to  demonstrate  that  not  aspects  of  leadership  fit  every  situation. 

Presence  is  the  impression  a  leader  makes  on  others,  contributes  to  his  success  in  leading 
them,  and  is  the  sum  of  a  leader’s  outward  appearance,  demeanor,  actions,  and  words. [1]  Presence 
includes  Military  and  Professional  Bearing,  Fitness, Confidence  and  Resilience.  For  the  purposes 
of  the  leadership  wargame,  evaluators  will  apply  the  principles  of  military  and  professional  bearing, 
confidence,  and  resilience.  Fitness  will  not  be  included  in  the  evaluation. 
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Intellectual  Capacity  is  the  impression  a  leader  makes  on  others,  contributes  to  his  success  in 
leading  them,  and  is  the  sum  of  a  leader’s  outward  appearance,  demeanor,  actions,  and  words. [1] 
Intellectual  capacity  includes  Mental  Agility,  Sound  Judgment,  Innovation  interpersonal  Tact  and 
Expertise.  For  the  purposes  of  the  leadership  wargame,  evaluators  will  apply  all  of  these  principles. 

3  Leadership  Competencies 

It  is  also  important  to  develop  a  common  understanding  of  the  leadership  competencies.  The 
core  leadership  competencies  include  how  Army  leaders  lead  people;  develop  themselves,  their 
subordinates,  and  organizations;  and  achieve  the  mission.  The  competencies  are  the  most  out¬ 
wardly  visible  signs  of  a  leader’s  performance. [2]  These  competencies  include  Leads,  Develops, 
and  Achieves.  Leaders  apply  the  leadership  attributes  described  earlier  to  demonstrate  these  lead¬ 
ership  competencies. 

3.1  Leads 

Leads  is  defined  as  setting  goals  and  establishing  a  vision,  motivating  or  influencing  others  to 
pursue  the  goals,  building  trust  to  improve  relationships,  communicating  and  coming  to  a  shared 
understanding,  serving  as  a  role  model  by  displaying  character,  confidence,  and  competence,  and 
influence  outside  the  chain  of  command.  [1]  ADRP  6-22  describes  multiple  aspects  of  leads.  The 
wargame  evaluation  will  focus  on  Leads  Others,  Builds  Trust,  Communicates,  Extends  Influence 
beyond  the  Chain  of  Command,  and  Leads  by  Example.  Evaluators  will  apply  these  five  leads 
principles  to  assess  leadership  throughout  the  game  play. 

3.2  Develops 

Develops  is  defined  as  fostering  teamwork;  expressing  care  for  individuals;  promoting  learning; 
maintaining  expertise,  skills  and  self-awareness;  coaching,  counseling  and  mentoring  others;  fos¬ 
tering  job  development,  and  stewarding  the  profession  of  Arms.[l]  While  develops  is  generally 
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considered  a  long  term  process,  the  wargame  provides  some  opportunities  to  assess  develops.  The 
wargame  evaluation  will  focus  on  the  principles  of  Creates  a  positive  environment/  Fosters  esprit 
de  corps ,  Prepares  Self,  and  Develops  Others.  Evaluators  will  use  these  principles  to  determine 
how  well  a  participant  develops  himself  or  herself  as  well  as  others  throughout  the  game  play. 

3.3  Achieve 

Achieves  is  defined  as  setting  priorities,  organizing  taskings,  managing  resources,  executing  plans 
to  accomplish  the  mission,  and  achieving  goals. [1]  While  Achieves  is  a  stand  alone  principle,  it 
is  more  than  simply  winning.  It  includes  the  setting  and  realization  of  short-term  and  long-term 
goals.  Evaluators  will  apply  this  principle  to  evaluate  how  well  a  participant  achieves  his  or  her 
goals  throughout  the  game  play. 

4  Wargame  evaluation. 

This  chapter  describes  how  the  evaluation  processes  is  conducted.  This  process  is  designed  to 
complement  the  conduct  of  the  leadership  wargame  but  can  be  adapted  to  additional  leadership 
environments. 

4.1  Roles 

Prior  to  the  start  of  the  game,  roles  are  assigned.  This  includes  player’s  roles,  moderators,  and 
evaluators.  While  it  can  be  accomplished  with  less,  it  is  recommended  that  a  minimum  of  one 
senior  evaluator  and  seven  peer  evaluators  (one  per  player)  be  assigned.  Ideally,  roles  are  assigned 
at  least  a  week  prior  to  the  start  of  the  game.  This  allows  players  and  evaluators  time  to  prepare  for 
their  prospective  roles.  The  expectation  is  that  players  and  evaluators  conduct  additional  research 
to  aid  them  in  the  conduct  of  their  game  and  evaluation  strategies.  Potentially,  this  additional 
research  can  be  captured  and  shared  in  a  strategic  estimate,  or  similar  document.  This  could  be 
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presented  before,  during,  or  after  the  game  play  and  could  include  public  (shared  with  everyone) 
and  private  (shared  with  only  evaluators)  considerations. 

4.1.1  Senior  Evaluator 

The  senior  evaluator  controls  the  entire  evaluation  process.  Ideally,  this  senior  evaluator  is  outside 
of  a  any  player’s  rating  chain.  For  example,  if  conducted  at  the  battalion  staff  level,  the  battalion 
commander  may  request  a  sister  battalion’s  S-3  or  Executive  Officer  to  serve  as  the  senior  evaluator. 
Ultimately,  the  senior  evaluator  will  provide  consolidated  but  anonymous  feedback  to  the  unit 
leader  on  potential  leadership  trends  identified  from  the  conduct  of  the  wargame. 

4.1.2  Evaluator 

The  evaluator  provides  feedback  to  one  or  more  players.  This  evaluator  is  intended  to  be  a  peer 
with  similar  rank  and  position  as  the  player.  The  evaluator  will  use  the  tools  provided  in  this 
guide  or  developed  within  the  unit  to  capture  specific  examples  of  the  leadership  attributes  and 
competencies  demonstrated  during  the  game.  The  evaluator  will  conduct  a  peer-to-peer  individual 
AAR  with  the  player  evaluated  and  will  provide  the  insights  identified  to  the  senior  evaluator. 

4.2  Evaluation  Process 

The  wargame  evaluation  is  done  in  three  stages.  It  is  the  responsibility  of  an  evaluator  to  understand 
all  three  phases  of  the  evaluation.  The  three  phases  are  Game-Play  Evaluation ,  Interx’iew  and 
Feedback ,  and  Consolidated  AAR. 

4.2.1  Game-Play  Evaluation 

The  Game-Play  Evaluation  phase  begins  with  the  formation  of  all  game  participants  (players, 
evaluators,  and  moderators)  and  ends  when  the  game  is  complete  by  either  completion  of  all  turns, 
decision  by  the  moderator  to  conclude  the  game,  or  a  specified  time  limit  has  elapsed.  The  Turn  by 
Turn  assessment  sheet  is  recommended  to  aid  the  evaluator  in  conduct  of  the  evaluation.  The  the 
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tum-by-turn  evaluation  is  found  and  described  in  appendix  A  is  designed  to  assist  the  evaluator  in 
capturing  leadership  attributes  and  competencies  demonstrated  throughout  the  game  play. 

It  is  expected  that  there  will  be  some  interaction  between  the  evaluator  and  player  during  the 
game.  The  wargame  will  ebb  and  flow  allowing  the  evaluator  to  best  determine  when  these  inter¬ 
actions  should  occur.  An  example  of  this  may  be  the  need  to  understand  a  player’s  strategy  and 
goals.  Some  players  may  have  a  well  written  out  strategy  while  other  players  may  not  have  their 
strategy  written  down  at  all.  Either  way  it  will  be  important  to  ask  the  player  details  about  the 
strategy  including  changes  made  to  it  throughout  the  game. 

4.3  Interview  and  Feedback 

The  Interview  and  Feedback  game  play  evaluation  phase  begins  when  the  game  is  complete  and 
ends  when  all  players  have  received  their  individual  feedback.  The  leadership  competencies  as¬ 
sessment  sheet  described  in  appendix  C  and  the  leadership  attributes  assessment  sheet  described  in 
appendix  B  are  designed  to  assist  the  evaluator  in  consolidating  behaviors  and  trends  of  leadership 
exemplified  by  the  player  throughout  the  game.  At  some  point  near  or  immediately  after  comple¬ 
tion  of  the  game,  the  evaluator  should  take  time  to  reorganize  the  information  from  all  of  the  turn 
by  turn  assessment  sheets  which  are  chronological  into  a  leadership  model  framework. 

This  is  intended  to  be  a  two  way  conversation  or  AAR  between  the  evaluator  and  player  in 
which  the  evaluators  present  their  observations  tactfully  about  the  player  but  also  captures  addi¬ 
tional  insights  from  the  player  about  other  player’s  leadership.  These  observations  should  then  be 
added  to  the  consolidated  AAR  process.  An  example  of  this  may  be  that  the  evaluated  player  may 
have  been  more  (or  less)  apt  to  work  with  another  player  to  achieve  particular  goals  based  how 
persuasive  (or  unpersuasive)  the  other  player  was. 

4.4  Consolidated  AAR 

The  Consolidated  AAR  phase  begins  with  completion  of  all  individual  AARs  and  ends  with  the  final 
compilation  of  trends  to  the  unit  leader.  The  evaluators  provide  their  individual  AAR  feedback  to 
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include  captured  insights  from  the  players  to  the  senior  evaluator.  While  this  information  can  be 
provided  after  the  consolidated  AAR  is  complete,  it  may  help  to  have  this  information  before  hand 
to  guide  the  AAR. 

The  consolidated  AAR  is  intended  to  be  an  anonymous  evaluation  of  leadership  trends  and  is 
led  by  the  senior  evaluator.  The  goal  of  the  consolidated  AAR  is  to  identify  leadership  trends. 
It  is  not  intended  to  discuss  the  game  itself  except  where  that  discussion  focuses  on  leadership. 
Winning  (getting  results)  is  part  of  leadership  and,  therefore,  should  NOT  be  omitted  from  the 
conversation.  However,  winning  is  only  one  portion  of  the  assessment. 

Ideally,  the  senior  evaluator  will  provide  a  report  to  the  unit  leader  on  trends  of  leadership 
found  from  conduct  of  the  wargame.  This  may  be  as  simple  as  the  unit  leader  attending  the  AAR 
or  may  include  a  final  writeup  from  the  senior  evaluator. 
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A  Turn  by  Turn  Assessment  Sheet 


The  following  page  is  a  developed  example  of  a  turn  by  turn  assessment  sheet.  It  is  designed  to 
be  a  full  page  document  that  can  produced  in  mass  to  aid  in  the  evaluation  of  players  during  the 
game  play.  The  turn  by  turn  assessment  sheet  has  three  areas  of  interest.  These  sections  include 
the  Header,  Definitions,  and  Observations. 

A.l  Header 

The  Header  contains  name  of  the  player,  the  role  the  player  has  been  assigned,  and  the  turn  number. 
To  maintain  complete  anonymity,  the  name  can  be  left  blank.  The  turn  is  useful  to  identify  trends 
and  growth.  For  example,  a  player  may  make  a  “mistake"  in  turn  one,  realize  that  “mistake"  and 
learn  from  it  in  turn  three.  This  could  be  considered  an  example  of  resilience. 

A.2  Definitions 

The  Definitions  section  contains  a  description  of  each  leadership  competency  and  attribute.  It 
is  intended  to  prompt  the  evaluator  to  look  for  specific  competencies  and  attributes  as  well  as 
identify  behaviors  that  fall  into  one  or  more  categories.  It  is  not  expected  that  all  attributes  and 
competencies  would  be  observed. 

A.3  Observations 

The  Obsen’ations  section  is  used  to  capture  the  observed  behaviors  as  well  as  make  notes.  Addi¬ 
tional  comments  can  be  continued  on  the  back  of  the  sheet. 


10 


Observer  Log:  Turn-by-Turn  Assessment 


Name: 

Role: 

Turn: 

Leads 

Leads  others 

Influence  techniques. 

Interventions  to  improve  situations. 

Mission  accomplishment 

Builds  trust 

Demonstrates  trust  in  others. 

Relates  to  others  and  builds  positive  rapport 

Addresses  problems  that  undermine  trust. 

Extends  Influence  beyond  the  chain  of  command 

Establishes  trust  outside  the  chain  of  command. 

Proactively  builds  and  maintains  alliances 

Rational  persuasion,  inspirational  appeals,  or  consultation  techniques. 

Develops 

Creates  a  positive  environment/  Fosters  esprit  de  corps 

Exemplifies  a  positive  attitude. 

Encourages  innovative,  critical,  and  creative  thought. 

Leverages  lessons  learned  to  improve  organization. 

Prepares  self 

Demonstrates  knowledge  management  through  background  research. 

Continued  to  seek  knowledge  as  game  progressed 

Integrates  information  from  multiple  sources. 

Develops  others 

Recognized  opportunities  to  provide  feedback  to  others 

Provided  coaching,  counseling  and  mentoring. 

Encouraged  others  to  go  beyond  their  comfort  zone 

Leads  by  Example 

Demonstrated  competence,  confidence,  commitment. 

Demonstrated  willingness  to  compromise 

Accepted  responsibility 

Communicates 

Maintains  listener  interest  (verbal  and  non-verbal). 

Adjusts  information-  sharing  strategy 

Body  language  matched  message 

Achieves 

Achieves 

Stayed  focused  on  the  overall  objective 

Understood  the  game  process  and  objectives 

Met  the  game  objectives 

Presence 

Military  and  Professional  Bearing 

Modeled  a  professional  image  of  authority. 

Presence  energized  others. 

Exemplifies  adherence  to  standards. 

Confidence 

Projects  self-confidence. 

Models  composure  in  adverse  situations. 

Managed  stress  in  self  and  sensitive  to  stress  on  others. 

Resilience 

Quickly  recovers  from  setbacks. 

Focused  on  the  objectives  in  the  midst  of  shock  and  stress. 

Learned  from  adverse  situations 

Sound  Judgment 

Engaged  in  thoughtful  assessment. 

Confidently  made  decisions  in  the  absence  of  all  of  the  facts. 

Assessed  risk  of  own  as  well  as  others'  decisions  throughought  the  game. 

Innovation 

Introduced  new  ideas  when  opportunities  existed. 

Creatively  approached  challenges. 

Adapted  existing  TTPs  to  a  unique  problem. 

Interpersonal  Tact 

Demonstrated  proficient  interaction  with  others. 

Effectively  adjusted  behaviors  when  interacting  with  others. 

Understands  character  and  motives  of  others  and  modified  behavior. 

Intellectual 

Mental  Agility 

Expertise 

Capacity 

Modeled  a  flexible  mindset 

Anticipated  changing  conditions. 

Used  multiple  approaches  when  developing  courses  of  action. 

Demonstrated  expert-level  proficiency 

Demonstrated  understanding  of  joint,  cultural  and  geopolitical  knowledge. 

Conveyed  knowledge  to  others. 

Observations 

B  Leadership  Attributes  Assessment  Sheet 


The  leadership  attributes  assessment  sheet  is  designed  to  be  a  full  page  document  that  can  pro¬ 
duced  in  mass  to  aid  in  the  evaluation  of  players  after  completion  of  the  game  play  and  follows 
the  description  below.  The  evaluator  consolidates  the  information  identified  during  the  game  and 
captured  on  the  turn  by  turn  assessment  sheet  onto  the  leadership  attributes  assessment  sheet.  The 
leadership  attributes  assessment  sheet  has  several  areas  of  interest  as  shown  in  figure  2.  These  sec¬ 
tions  include  the  Header ,  Attribute,  Potential  Score  Area,  Observation  Example,  Area  of  Emphasis, 
and  Area  of  Emphasis  Example. 


Figure  2:  Attributes  Example;  1.  Header  2.  Attribute  3.  Potential  Score  4.  Observation  Example 
5.  Area  of  Emphasis  6.  Area  of  Emphasis  Example 


B.l  Header 

The  Header  shown  in  figure  2  section  1,  contains  name  of  the  player  and  the  role  the  player  has 
been  assigned.  To  maintain  complete  anonymity,  the  name  can  be  left  blank. 

B.2  Attribute 

The  Attribute  shown  in  figure  2  section  2,  contains  name  of  the  attribute  being  described. 
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B.3  Potential  Score 


The  Potential  Score  shown  in  figure  2  section  3,  may  used  to  rate  the  level  attribute  observed.  For 
example  on  a  scale  of  1  to  5,  5  being  the  best,  1  being  the  worst,  an  evaluator  may  evaluate  the 
player  at  a  4  (high)  for  Military  and  Professional  Bearing.  Other  applications  of  this  area  include 
a  check  box  to  identify  if  that  particular  attribute  was  observed. 

B.4  Observation  Example 

The  Obserx’ation  Example  shown  in  figure  2  section  4,  is  used  to  provide  specific  examples  of  the 
attribute  observed  on  the  turn  by  turn  assessment  sheet.  For  example,  an  evaluator  may  observe 
that  a  player  demonstrated  professional  bearing  even  in  the  face  adversity.  This  could  fall  under 
the  military  and  professional  bearing  attribute.  Additional  examples  may  be  found  in  appendix  D. 

B.5  Area  of  Emphasis 

The  Area  of  Emphasis  shown  in  figure  2  section  5,  describes  one  of  three  components  of  an  attribute 
to  emphasize.  These  components  help  the  evaluator  shape  and  focus  the  leadership  evaluation. 

B.6  Area  of  Emphasis  Example 

The  Area  of  Emphasis  Example  shown  in  figure  2  section  6,  may  used  to  provide  specific  examples 
of  the  attribute.  For  example,  an  evaluator  may  observe  that  a  player  maintained  a  calm  demeanor 
when  discussing  potentially  antagonistic  situations  with  other  players.  This  could  be  a  specific 
example  of  a  military  and  professional  attribute.  Additional  examples  may  be  found  in  appendix 
D. 
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Observer  Log:  Leadership  Attributes 


C  Leadership  Competencies  Assessment  Sheet 


The  leadership  competencies  assessment  sheet  is  designed  to  be  a  full  page  document  that  can 
produced  in  mass  to  aid  in  the  evaluation  of  players  after  completion  of  the  game  play  and  follows 
the  description  below.  The  evaluator  consolidates  the  information  identified  during  the  game  and 
captured  on  the  turn  by  turn  assessment  sheet  onto  the  leadership  competencies  assessment  sheet. 
The  leadership  competencies  assessment  sheet  has  several  areas  of  interest  as  shown  in  figure  3. 
These  sections  include  the  Header,  Competency,  Potential  Score  Area,  Obserx’ation  Example,  Area 
of  Emphasis,  and  Area  of  Emphasis  Example. 


1.  Header 


Name:  Role: 

2.  Competency 

Competency  |  Areas  of  Emphasis 

5.  Area  of 

3.  Potential  Score 

Leads 

Leads  others 

Demonstrated  influence 

|  improve  situations. 

1  -ssesses  and  monitors  mission 

laccomplishment 

Emphasis 

6.  Area  of 

4.  Observation 
Example 

Builds  trust 

Demonstratestrust  in  others. 

Relatesto  othersand  builds 

positive  rapport 

Addresses  prcblemsthat 
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Figure  3:  Competencies  Example;  1.  Header  2.  Competency  3.  Potential  Score  4.  Observation 
Example  5.  Area  of  Emphasis  6.  Area  of  Emphasis  Example 


C.l  Header 

The  Header  shown  in  figure  3  section  1,  contains  name  of  the  player  and  the  role  the  player  has 
been  assigned.  To  maintain  complete  anonymity,  the  name  can  be  left  blank. 
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C.2  Competency 

The  Competency  shown  in  figure  3  section  2,  contains  name  of  the  competency  being  described. 

C.3  Potential  Score 

The  Potential  Score  shown  in  figure  3  section  3,  may  used  to  rate  the  level  competency  observed. 
For  example  on  a  scale  of  1  to  5,  5  being  the  best,  1  being  the  worst,  an  evaluator  may  evaluate  the 
player  at  a  5(Very  High)  for  Leads  Others.  Other  applications  of  this  area  include  a  check  box  to 
identify  if  that  particular  competency  was  observed. 

C.4  Observation  Example 

The  Obser\’ation  Example  shown  in  figure  3  section  4,  is  used  to  provide  specific  examples  of  the 
competency  observed  on  the  turn  by  turn  assessment  sheet.  For  example,  an  evaluator  may  observe 
that  a  player  Player  led  and  maintained  coalitions  during  the  game.  This  could  fall  under  the  Leads 
Others  competency.  Additional  examples  may  be  found  in  appendix  D. 

C.5  Area  of  Emphasis 

The  Area  of  Emphasis  shown  in  figure  3  section  5,  describes  one  of  three  components  of  a  compe¬ 
tency  to  emphasize.  These  components  help  the  evaluator  shape  and  focus  the  leadership  evalua¬ 
tion. 

C.6  Area  of  Emphasis  Example 

The  Area  of  Emphasis  Example  shown  in  figure  3  section  6,  may  used  to  provide  specific  examples 
of  the  competency.  For  example,  an  evaluator  may  observe  that  a  player  used  methods  ranging 
from  compliance  to  commitment  to  accomplish  objectives.  This  could  be  a  specific  example  of  a 
leads  others  competency.  Additional  examples  may  be  found  in  appendix  D. 
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Maintains  listener  interest  Adjusts  information-  sharing  Body  language  matched 

(verbal  and  non-verbal). _ strategy _ message _ 


Observer  Log:  Leadership  Competencies 


D  Example  Competencies  and  Attributes  Sheet 


The  following  pages  provide  an  example  of  potential  input  captured  during  a  wargame.  Note  that 
not  all  areas  of  emphasis  are  filled  in  and  that  this  is  a  very  positive  evaluation.  This  is  only 
intended  to  aid  evaluators  in  providing  some  examples. 
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Observer  Log:  Leaership  Competencies 


Observer  Log:  Leaership  Attributes 


GLOSSARY 


LAT 

LDW 

MRO 

TRAC 

TRADOC 


Leadership  Assessment  Tool 
Leadership  Development  Wargame 
Military  Research  Office 

Training  and  Doctrine  Command  Analysis  Center 
Training  and  Doctrine  Command 
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This  page  intentionally  left  blank. 
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